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Lepton-flavor violation (LFV) involving charged lep- 
tons has never been observed, and stringent experimental 
limits exist [H-[3|- The experimental observation of neu- 
trino oscillations [3| implies that, within the standard 
model (SM), there are amplitudes contributing to LFV 
in the charged sector, although their effects must be well 
below the current experimental sensitivity Q . Many de- 
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scriptions of physics beyond the SM predict enhanced 
LFV in r decays over fi decays with branching fractions 
within present experimental sensitivities [6j-l8| . An obser- 
vation of LFV in t decays would be a clear signature of 
new physics, while improved limits will further constrain 
models. 

This paper reports the latest results from BABAR on the 
search for LFV in the neutrinoless decay t~ — > ', 
where ti — e,fi [9|. All six lepton combinations consis- 
tent with charge conservation are considered. The anal- 
ysis is based on data recorded by the BaBAR de- 
tector at the PEP-II asymmetric-energy e + e~ B factory 
operated at the SLAC National Accelerator Laboratory. 
The data sample is provided by an integrated luminos- 
ity of 426 flV 1 recorded at a center-of-mass (cm.) en- 
ergy y/s = 10.58 GeV, and of 42fb _1 recorded at about 
= 10.54 GeV. With these conditions, the expected 
cross section for r-pair production is a TT = 0.919 ± 0.003 
nb [llj], corresponding to a data sample of about 430 
million r-pairs. 

Charged-particle (track) momenta are measured with a 
5-layer double-sided silicon vertex tracker and a 40-layer 
helium- isobutane drift chamber inside a 1.5 T supercon- 
ducting solenoid magnet. An electromagnetic calorime- 
ter consisting of 6580 CsI(Tl) crystals is used to measure 
electron and photon energies, a ring-imaging Cherenkov 
detector is used to identify charged hadrons, and the in- 
strumented magnetic flux return (IFR) is used to identify 
muons. About half of the data sample under study was 
recorded with the IFR instrumented with resistive plate 
chambers (RPC). During the second half of the data tak- 
ing period most RPCs were replaced by limited streamer 
tubes in the barrel section of the IFR. 

A Monte Carlo (MC) simulation of lepton-fiavor vio- 
lating t decays is used to estimate the signal efficiency 
and optimize the search. Simulated r-pair events includ- 
ing higher-order radiative corrections are generated us- 
ing KK2f [l2j with one r decaying to three leptons with 
a uniform three-body phase space distribution, while the 
other t decays according to measured rates 13] simu- 
lated with Tauola 0]. Final-state radiative effects are 
simulated for all decays using Photos [15]. The detector 
response is simulated with GEANT4 0. 

The signature for t~ — > (-i^-t^z ^ s a se ^ °f three 
charged particles, each identified as cither an e or a jjL, 
with an invariant mass and energy equal to that of the 
parent r lepton. Events are preselected requiring four 
reconstructed tracks and zero net charge, selecting only 
tracks pointing toward a common region consistent with 
t + t~ production and decay. The polar angles of all four 
tracks in the laboratory frame are required to be within 
the calorimeter acceptance range, to ensure good particle 
identification. The event is divided into two hemispheres 
in the e + e~ cm. frame using the plane containing the 
interaction point and perpendicular to the thrust axis, as 
calculated from the observed tracks and neutral energy 
deposits. The signal hemisphere must contain exactly 
three tracks (3-prong) with an invariant mass less than 



3.5 GeV/c 2 , while the other hemisphere must contain ex- 
actly one (1-prong) track, and may contain also neutral 
energy deposits. In order to reduce backgrounds coming 
from photon conversions we require that the two couples 
of oppositely charged tracks in the 3-prong hemisphere 
have an invariant mass, calculated using electron mass 
hypothesis for the tracks, larger than than 20MeV/c 2 , or 
30MeV/c 2 for e~e + e~and e~/i + /i~. 

With respect to our previous result [13], this analy- 
sis relies on significantly improved particle identification 
(PID) techniques for both /x ± and e ± . Electrons are iden- 
tified applying a multivariate algorithm which uses as in- 
put the ratio of calorimeter energy to track momentum 
(E/p), the ionization energy loss in the tracking system 
(dE/dx), and the shape of the shower in the calorime- 
ter. Muon identification exploits a bagged decision tree 
(BDT) 18] algorithm, which uses as input the number 
of hits in the IFR, the number of interaction lengths 
traversed, and the energy deposition in the calorimeter. 
Since \i with momenta less than 500 MeV/c do not pen- 
etrate enough into the IFR to provide useful information, 
the BDT also uses information obtained from the inner 
trackers to maintain a very low ir — fj, misidentification 
probability with high selection efficiencies. The electron 
and muon identification efficiencies are measured to be 
91% and 77% respectively. The probability for a ir^ 1 to 
be misidentified as an in 3-prong r decays is 2.4%, 
while the probability to be misidentified as a /x ± is 2.1%. 

The quantity AE = E* cc — E£ cara is defined, where 
E* cc is the total energy of the system observed in the 
3-prong hemisphere and ££ eam is the beam energy (the 
superscript 7k- indicates quantities measured in the cm. 
frame). We define AM ec = M ec - m T with M 2 c = 
Ebeam/ c4 ~ \P3i\ 2 / ° 2 > where |p| ; | 2 is the squared momen- 
tum of the 3-prong system, m T = 1.777 GeV/c 2 is the r 
mass 13], and the energy constrained momentum of the 
3-prong system, [p£ z |, is obtained from a kinematic fit: 
the fit requires the r energy measured in the cm. to be 
\J s/2, taking into account the errors on the reconstructed 
track parameters and the beam energy measurement. 

The signal distributions in the (AM ec , AE) plane (see 
Fig. [IJ are broadened by detector resolution and radia- 
tive effects. In all decay modes, the radiation of pho- 
tons from the incoming e + e~ particles and from the 
outgoing t decay products leads to a tail at low values 
of AE. Radiation from the final-state leptons, which 
is more likely for electrons than for muons, produces 
a tail at high values of AM ec as well. Signal regions 
(SR) in the (AM ec , AE) plane are optimized in order 
to obtain the smallest expected upper limit (UL) when 
no LFV signal is present. The expected ULs are esti- 
mated using MC simulations and data control samples, 
instead of candidate signal events. The upper right cor- 
ner of the signal region in the (AM ec , AE) plane, in 
units of (MeV/c 2 , MeV), is fixed at (30,50) for ^e+e~ 
and e~/i + /i~ and at (30, 100) for the other four chan- 
nels. The lower left corner is at (—30, —300) for the 
e~e + e~, /i~e + e~, and e~/x" l 7x _ decay modes, (—30,-350) 



5 



^ 0.2 
> 

O -o 

w 

< -°- 2 



x" — > 

•' 1 ' ' r 


1 i 1 

e" e + e" - 

j-" ; 


x" — > 


ll + e~e~ ■ 
1 

1 ' r ' 


X" -» 
■ E 

' 1 

• ' i •'" — ^- 


u~e + e~ - 
!'■ - 


X" -> 

J 

' ! 1 'l ' 


e + |T |i" 

3 '- 

1 ; 


x" -» 
1 

: ' r , i 


e" (i + |i" . 
'- 

i 


X" -> 

- 

■1 ■ It, 


i ' -i ' 

- 

. , i , 



-0.4 -0.2 0.2 



-0.4 -0.2 0.2 



A M ec (GeV/c 2 ) 

FIG. 1: Data events (dots) in the large box of the (AM ec , AE) 
as defined in the text, for the six r decay channels after all 
selection is applied. The solid black lines are the boundaries, 
for each channel, of the signal region. The dark and light 
shadings represent the 50% and 90% signal contours respec- 
tively. 



for [i + e~e~ and e + /i~/i~, and (—25,-200) for /i~fj, + /i~ . 
Fig.[T]shows the observed data in the (AM ec , AE) plane, 
along with the signal region boundaries and the expected 
signal distributions. To avoid biases, a blind analysis pro- 
cedure was followed, with the number of events in the SR 
remaining unknown until the selection criteria were final- 
ized and all cross-checks were performed. 

Each track present in the signal hemisphere must be 
identified as either a muon or an electron, depending on 
the channel under study. For the channels where two 
tracks of the same charge sign can be either an electron or 
a muon (i.e. /i~e + e~ and e~/i + /i~), it is possible that both 
tracks satisfy both electron and muon PID selectors: in 
these rare cases we measure AM ec and AE in both mass 
hypotheses. For all events showing this behavior only one 
of the two combinations falls in the large box (LB) of the 
(AM ec , AE) plane, defined as the region lying between 
-600 and 400MeV/c 2 in AM ec and -700 and 400 MeV 
in AE. 

The PID requirements strongly suppress background, 



but further selection is applied: for all decay modes, 
the momentum of the 1-prong track is required to be 
less than 4.8 GeV/c in the cm. frame. The 1-prong 
side t mass is approximately reconstructed from the 4- 
momentum obtained by adding the 1-prong track, the 
neutral energy deposits in the 1-prong hemisphere, and 
the missing 3- momentum of the event, assuming a zero 
mass as is appropriate if just a single neutrino is miss- 
ing. This invariant mass is required to be in the range 
0.2 — 3.0 GeV/c 2 for e~e + e~, [i~e + e~ , and e~fi + [i~ , and 
in the range of 0.1 — 3.5 GeV/c 2 for [i + e~e~ , e + fi~fi~ , 
and (j,~fj, + [i~ . To suppress Bhabha backgrounds we reject 
events where any oppositely charged track pair has an in- 
variant mass compatible with a photon conversion when 
assigning the electron mass to the two tracks. M e + e - is 
required to be < 200 MeV/ c 2 for all channels except for 
e + [i~(j,~ where M e + e - < 300MeV/c 2 is required. For the 
e~e + e~ and e~/i + /i~ decay modes, the charged particle 
in the 1-prong hemisphere is required to be matched to 
an energy deposit in the calorimeter inconsistent with an 
electron, and must not be identified as an electron, while 
for the ^ + e~e~, /i~e + e~, and decay modes this 

track must not be identified as a muon. For the e~e + e~ 
and e _ /z + /Lt~ decay modes, the missing momentum of the 
event should be greater than 300MeV/c, for e~/i + /i~ and 
fi~fi + /j,~ this should be more than 200MeV/c and for 
/i + e~e~ and e + /i~/!~this lower limit is set at lOOMeV/c. 
For the e - e + e~ and /i + e~e~ channels the cosine of the 
angle between the direction of the sum of the three sig- 
nal track momenta and the direction of the 1-prong track 
momentum (#13), is required to satisfy cos(0i3) > —0.995 
and cos(0i3) > —0.997 respectively, to further reduce 
Bhabha contributions. 

The backgrounds still contaminating the sample have 
been identified in three broad categories: low multiplicity 
qq events (comprising both continuum light quark pairs 
and cc pairs), QED events (Bhabha or depending 
on the particular channel), and SM t + t~ events. These 
three background classes have distinctive distributions in 
the (AM ec , AE) plane. The qq events tend to populate 
the plane uniformly, while QED backgrounds fall in a 
narrow band at positive values of AE, and t + t~ back- 
grounds are restricted to negative values of both AE and 
AMgc due to the presence of at least one undetected neu- 
trino. The possible background contribution arising from 
two-photon processes has been studied on a data control 
sample, as discussed in the following, and it is found to 
be negligible. 

The expected background rates for each decay mode 
are determined by fitting a set of probability density 
functions (PDFs) to the observed data in the grand side- 
band (GS) region of the (AM ec , AE) plane as was done 
in the previous published analysis [17 1. The GS region 
covers the same region as the LB but does not include 
the SR. The functional forms of the PDFs are the same 
as in 17]. For the qq background, a two-dimensional 
PDF is constructed from the product of two PDFs, Pm 1 
and Pb 1 , where Pm'(AM') is a bifurcated Gaussian and 
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Pe'(AE') = (1 - x/Vl + x 2 )(l +ax + bx 2 + cx 3 ) with 
x = (AE' - d)/e. The (AM',AE') axes have been 
slightly rotated from (AM ec: AE) to take into account 
the observed correlation between AE and AM ec for the 
distribution. For the t + t~ background PDF, the func- 
tion Pm"(AM") is the sum of two Gaussians with com- 
mon mean, while the functional form of Pe"{AE") is 
the same as that for the qq PDF. To properly model 
the wedge-shaped distribution due to the kinematic limit 
in tau decays, a coordinate transformation of the form 
AM" = cos/3iAM ec ± shift AE and AE" = cos/3 2 A£ - 
sin/?2AM ec is performed. 

QED backgrounds represent one of the major sources 
of backgrounds for e~e + e~, /i + e~e~, /i~e + e - , and 
e~n + pT . To study this background category, specially 
selected control samples obtained from data were pro- 
duced. Two different methods were used to extract QED 
control samples: for e - e + e~, /i + e~e~, and e~/i + /i~ chan- 
nels the sample was produced selecting events passing all 
selection requirements, except the lepton veto in the tag 
side, and requiring the track in the tag-side to be iden- 
tified as a muon (p + e~e~ channel) or as an electron (for 
the other two channels). To obtain a large enough sample 
for the fi~e + e~ channel we selected events where a muon 
is present in the tag-side, and the reconstructed mass in 
the tag-side is between 0.5GeV/c 2 and 2.5GeV/c 2 , and 
the momentum of the tag-side particle is required to be 
larger than 4.8GeV/c. To fit these control samples, an 
analytic PDF is constructed from the product of a Crys- 
tal Ball function [19j in AE' and a third-order polynomial 
in AM', where again the (AM', AE') axes have been ro- 
tated slightly from (AM ec ,A£) to fit the observed dis- 
tribution. 

The expected background rate in the SR is obtained 
by an unbinned maximum likelihood fit to the data in the 
GS region, with the shapes of the three background PDFs 
fixed by making an unbinned likelihood fit to the MC and 
the control samples. The PDF shape determinations and 
background fits are performed separately for each of the 
six decay modes. Cross-checks of the background estima- 
tion are performed by considering the numbers of events 
expected and observed in sideband regions immediately 
neighboring the signal region for each decay mode. 

The efficiency of the selection for signal events is esti- 
mated with the MC simulation of signal LFV events. The 
efficiency of signal MC passing preselection requirements 
varies between 45% and 49%. The total efficiency for 
signal events to be found in the signal region is shown 
in Table Q] for each decay mode and ranges from 6.4% 
to 12.7%. This efficiency includes the 85% branching 
fraction for 1-prong r decays. With respect to the pre- 
vious analysis, improvements in particle ID, in tracking 
algorithms and in selection criteria allowed us to obtain 
higher signal efficiencies along with a reduction of the 
expected backgrounds thus improving the UL sensitivity. 

Uncertainties in signal efficiency estimation and in the 
number of the expected events in the SR obtained by the 
fit affect the final result. The systematic uncertainties 



TABLE I: Efficiencies, numbers of expected background 
events (Ab g d), expected branching fraction upper limits at 
90% CL (ULgQ P ), numbers of observed events (A b s ), and ob- 
served branching fraction upper limits at 90% CL (ULgg s ) for 
each decay mode. All upper limits are in units of 10 -8 . 



Mode 


Eff. [%] 


iVbgd 


UL^ P 


iVobs 


UL^ S 


e~e + e~ 


8.6 ±0.2 


0.12 ±0.02 


3.4 





2.9 


H~e + e~ 


8.8 ±0.5 


0.64 ±0.19 


3.7 





2.2 


H + e~e~ 


12.7 ±0.7 


0.34 ±0.12 


2.2 





1.8 




10.2 ±0.6 


0.03 ± 0.02 


2.8 





2.6 


e~/j, + jj,~ 


6.4 ±0.4 


0.54 ±0.14 


4.6 





3.2 




6.6 ±0.6 


0.44 ±0.17 


4.0 





3.3 



from PID dominate the error on the efficiency. They are 
estimated on data control samples, looking at the dis- 
crepancies between data and MC samples, by measuring 
the average spread for tracks with the same kinematic 
properties. These uncertainties vary between a relative 
error of 1.8% for e~e + e~ and 7.8% for . The mod- 

eling of the tracking efficiency contributes an additional 
1% relative uncertainty. All other sources of uncertainty 
in the signal efficiency are found to be smaller than 1.0%, 
including the statistical limitation of the MC signal sam- 
ples, the modeling of higher-order radiative effects, track 
momentum resolution, trigger performance, observables 
used in the selection criteria, and knowledge of the tau 
1-prong branching fractions. 

The systematic uncertainty due to errors in back- 
ground estimation is determined from fits to data in the 
GS region. In addition to varying PDF parameters by 
their uncertainties, alternative functional forms are used 
to determine the uncertainty on the expected background 
yield in the SR. The total errors on the background es- 
timates are reported in Table HI Systematics coming 
from unsimulated background contributions, such as two- 
photon processes, are checked using background enriched 
control samples. Two-photon processes are characterized 
by a small transverse momentum, so the control samples 
were produced selecting events with a transverse momen- 
tum smaller than 0.2 GeV/c, and with the momentum 
of the tag-side track in the center of mass smaller than 
4.0GeV/c. The uncertainties introduced by two-photon 
processes and unsimulated backgrounds are found to be 
negligible. 

Background expectations (A^gd) and the number of 
observed events (A^bs) are shown in Table |TJ No events 
are observed in the SR for any of the modes and we place 
90% confidence level (CL) ULs on the branching fractions 
using ULgg P = N^°J(2eLcr TT ), where N$° L is the 90% CL 
UL for the number of signal events when N y, s events are 
observed with A^gd background events expected. The 
values e, L, and a TT are the selection efficiency, lumi- 
nosity, and t + t~ cross section, respectively. The uncer- 
tainty on the product h-a TT is 0.9%. The branching frac- 
tion ULs are calculated, with all uncertainties included, 
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using the technique of Cousins and Highland [20] follow- 
ing the implementation of Barlow [2l|. The expected 
average upper limit ULgg P , defined as the mean UL ex- 
pected in the background-only hypothesis, is included in 
Table |U The 90% CL ULs on the t~ -> t^it^ branch- 
ing fractions are in the range (1.8 — 3.3) x 10~ 8 . These 
limits supersede the previous BaBAR analysis [13], and 
are compatible with the latest Belle limits (22|. 
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